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INFORMATION  CONTENT 


Section  1 
INTRODUCTION 

The  Air  Force  has  demonstrated  a  long  term  and  continuing  interest  in  the 
abilities  of  the  human  observer  to  abstract  information  from  imagery  dis¬ 
plays.  This  interest  has  manifested  itself  in  two  primary  areas: 

•  The  interpretation  of  reconnaissance/surveillance  imagery  for 
intelligence  and  targeting  purposes. 

•  The  acquisition  of  targets  for  weapon  delivery. 

In  the  first  case,  imagery  is  exploited  to  satisfy  stated  essential  elements 
of  information  (EEIs)  that  serve  as  part  of  a  broader  intelligence  collec¬ 
tion  effort.  These  EEIs  may  be  specific  to  the  imagery  acquisition  mission 
as,  for  example,  "Are  there  tanks  at  coordinates  XXXX  N  YYYY  E?"  In  other 
cases,  the  EEIs  may  be  in  the  form  of  standard  information  sets  to  be  pro¬ 
vided.  An  Air  Reconnaissance  Target  Reporting  Guide  (Anonymous,  1969),  for 
example,  calls  for  the  following  information  to  be  provided  from  imagery  of 
ai  rfields: 

•  Serviceability. 

•  Type  and  location  of  aircraft  present. 

•  General  activity  (special  purpose,  nonaircraft). 

•  Runway  pattern,  dimensions,  and  surface  materials. 

•  Types,  numbers,  and  locations  of  defenses. 

•  Type,  number,  size,  and  location  of  fuel  storage. 

•  Number  and  location  of  ammunition  storage  facilities. 

•  Number,  type,  construction,  and  sizes  of  hangars. 

•  Number,  type,  and  location  of  electronic  facilities. 

Reconnaissance  imagery  exploitation  is  usually  not  severely  time  critical; 
and  cycle  times,  from  receipt  of  imagery  at  the  interpretation  station  to 
the  production  of  an  interpretation  report,  typtcally  take  from  several 
minutes  to  hours. 
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In  the  target  acquisition  case,  two  purposes  are  to  be  satisfied.  First, 
the  pilot  (or  radar  navigator,  offensive  systems  operator,  weapon  systems 
operator,  etc.)  must  confirm  that  the  object  imaged  is  the  target  of  inter¬ 
est.  Second,  he  must  designate,  from  the  displayed  image,  the  target's 
location  to  a  weapon  delivery  computer.  These  tasks  are  much  more  time- 
compressed,  with  timelines  of  only  several  seconds  being  typical.  Because 
of  the  time  constraint,  great  reliance  is  placed  on  real-time  and  near  real¬ 
time  sensors  [e.g.,  forward-looking  infrared  (FLIR)  and  synthetic  aperture 
radar  (SAR)]. 

A  systems  approach  to  these  cases  decomposes  the  problem  into  three  subsys¬ 
tems:  the  sensor,  the  display  medium,  and  the  operator.  Research  and 
development  activities  continue  in  each  of  these  areas.  Kuperman  et  al . 
(1977)  present  a  series  of  studies  and  analyses  addressing  the  selection  of 
near-real -time  and  real-time  sensors  for  a  remotely  piloted  vehicle  tasked 
with  a  reconnaissance  mission.  Task  (1979)  provides  a  review  and  empirical 
comparison  of  several  methods  and  models  applicable  to  assessing  the  image 
quality  of  video  displays.  Research  to  quantify  the  abilities  of  the 
observer  range  from  basic  studies  of  visual  perception  (e.g.,  Carlson  and 
Cohen,  1978)  through  highly  applied  design  information  (e.g.,  Erickson, 
1978). 

A  related  area  of  research  has  attempted  to  deal  with  the  information  con¬ 
tent  and  utility  of  the  displayed  information  to  specific  task  require¬ 
ments.  Johnson  (1958)  established  the  concept  of  equating  system  resolution 
(lines  across  the  target's  critical  or  minimum  dimension)  with  performance 
in  reporting  the  detection,  classification,  and  recognition  of  military  tar<- 
gets.  Nygaard  et  al .  (1964)  attempted  to  relate  a  measure  of  information 
content  that  they  termed  "stimulus  complexity"  to  observer  performance. 

More  recently,  researchers  have  attempted  to  construct  and  apply  psycho¬ 
visual  ly  based  models  of  perception  to  the  information  extraction  task. 
Campbell  et  al.  (1970),  among  many  others,  reported  on  the  ability  of  the 
human  to  distinguish  between  gratings  of  sinusoidally  modulated  luminance  at 
different  spatial  frequencies.  The  explicit  application  of  the  techniques 
of  Fourier  decomposition  and  synthesis  were  reported  in  Campbell  et  al . 
(1968).  Parallel  applications  of  Fourier  techniques,  specifically  the 
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Modulation  Transfer  Function  (MTF),  have  taken  place  in  the  evaluation  of 
sensor  image  quality  (e.g.,  Gliatti,  1977;  and  Kuperman,  1980)  and  in 
creating  visual  describing  functions  (e.g.,  Cornsweet,  1970). 

One  approach  to  applying  Fourier  transform  based  methods  to  the  creation  of 
visual  system  describing  functions  being  pursued  at  Harry  G.  Armstrong  Aero¬ 
space  Medical  Research  Laboratory  (AAMRL)  was  reported  by  Ginsburg  (1978). 

He  applied  the  Contrast  Sensitivity  Function  (CSF)  to  attempt  to  account  for 
a  wide  range  of  visual  phenomena  including  illusions,  texture  perception, 
and  object  recognition.  The  CSF  is  essentially  a  visual  system  demand  curve 
that  describes  the  amount  of  modulation  required  for  detection  as  a  function 
of  spatial  frequency.  Ginsburg  suggested  that  evidence  existed  that  the  CSF 
was  actually  the  envelope  of  a  family  of  Gaussian  weighted,  bandpass  spatial 
filters  separated  from  each  other  in  center  frequency  at  1  octave  intervals 
and  each  exhibited  at  1  to  2  octave  bandwidth.  [Two  dimensional,  discrete 
Fourier  transform  applications  in  digital  image  processing  are  described  in 
Lewis  (1984)].  In  relating  the  CSF  to  the  identification  of  objects,  he 
stated : 

"Each  task  and  each  object  requires  slightly  different  numbers  of 
spatial  frequencies  or  harmonics.  For  example,  to  detect  the 
presence  of  an  object  requires  only  very  low  spatial  frequency, 
less  than  the  fundamental  spatial  frequency  of  the  object.  The 
classification  of  Snellen  letters  requires  from  about  1.5  to  2.5 
cycles  per  letter.  The  identification  of  a  face  from  a  small 
class  of  faces  requires  about  4  cycles  per  face  width." 

The  CSF  exhibits  a  peak  response  at  approximately  2  cycles  per  degree  and  is 
essentially  zero  at  spatial  frequencies  greater  than  65  cycles  per  degree. 
(In  order  to  permit  generalization  to  varied  imaging  and  viewing  conditions, 
the  resolution  of  the  acquired  imagery  is  specified  in  object  domain  (i.e., 
cycles  per  target  critical  dimension,  while  the  visual  requirements  of  the 
observer  are  stated  in  terms  of  the  number  of  cycles  per  angular  subtense  at 
the  eye.)  The  family  of  spatial  filters  is  also  referred  to  as  a  channel 
model  of  perception. 

Other  research  (Snyder,  1974)  has  attempted  to  form  a  unitary  measure  of 
image  utility,  including  the  observer,  by  bounding  the  area  below  the  system 


7 


MTF  curve  with  an  observer  visual  threshold  curve  and  reporting  the  area 
contained  between  the  two.  The  channel  model  representation  of  the  CSF  sug¬ 
gests  that  visual  perception  can  be  considered  to  be  a  hierarchial  decom¬ 
position  of  visual  stimuli,  with  each  channel  (filter)  making  distinct 
contributions  to  the  percept.-  Johnson  (1958)  reported  that  increasing 
levels  of  information  (cycles  per  target  dimension)  were  required  to  support 
increasing  levels  of  information  extraction.  These  findings  suggested  that 
the  bandpass  filters  should  demonstrate  a  relationship  with  an  image  quality 
measure  based  on  distinct  level  of  information  extraction.  The  present 
research  is  a  pilot  study  seeking  to  investigate  this  relationship. 
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Section  2 

INFORMATION  EXTRACTION 

Numerous  approaches  have  been  attempted  to  define  the  information  content 
levels  required  to  support  different  levels  of  observer  task  performance. 

The  Johnson  Criteria  (1958)  state  that  target  detection  requires  1.0  ±  0.25 
cycles  per  object  dimension,  orientation  reporting  requires  1.4  +  0.35 
cycles,  target  recognition  requires  4.0  +  0.8  cycles,  and  target  identifica¬ 
tion  requires  6.4  +  1.5  cycles.  This  early  work  has  been  refined  by  others 
(for  example,  Erickson,  1978)  but  has  remained  reasonably  unchanged  over 
time. 

A  standard  imagery  interpretation  handbook,  AFM  200-50  (1967),  attempts  to 
provide  guidelines  for  specifying  the  image  scale  required  in  aerial  photog¬ 
raphy  to  support  target  identification  and  detail  interpretation.  The  fol¬ 
lowing  table  is  extracted  for  aircraft. 

TABLE  1.  MINIMUM  SCALES  FOR  INTERPRETATION  AND  IDENTIFICATION 


Wing  Span 

Minimum  Scale 
for  Interpretation 

Minimum  Scale  for 

Detail  Interpretation 

Under  40  feet 

1/10,000 

1/2,000 

40  to  60  feet 

1/12,000 

1/3,000 

These  scales  are  based 

on  the  assumption  that  the  photographic  sensor 

exhibited  an  average  system  resolution  of  15  to  20  line  pairs  per  milli- 

meter.  Assuming  20  lines  per  millimeter  resolution,  the  required  scale  fac- 

tors  can  be  converted 

into  required  ground  resolved  distances  (GRDs). 

TABLE  2. 

GRDs  FOR  INTERPRETATION  AND  IDENTIFICATION 

GRD  for 

GRD  for  Detail 

Wing  Span 

Interpretation 

Interpretation 

Under  40  feet 

6.6  feet  (2.0  m) 

1.3  feet  (0.4  m) 

40  to  60  feet 

7.9  feet  (2.1  m) 

2.0  feet  (0.6  m) 
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An  Image  Interpretabil ity  Rating  Scale  was  adopted  (ASCC,  1978)  by  the 
representatives  of  the  U.S.  Air  Force,  U.S.  Navy,  Royal  Air  Force,  Royal 
Australian  Air  Force,  Royal  New  Zealand  Air  Force,  and  Canadian  Forces  for 
the  reporting  of  photographic  image  quality.  This  scale  provides  10  rating 
categories,  0  through  9.  Category  0  is  described  as  being  useless  for 
interpretation  due  to  cloud  cover,  poor  resolution,  etc.  Category  4  would 
support  the  recognition  of  aircraft,  for  example,  when  singly  deployed.  The 
GRDs  that  correspond  to  Category  4  are  i n  the  range  of  3.9  feet  (1.2  m) 
through  8.2  feet  (2.5  m) .  Category  6  of  this  scale  pertains  to  imagery  of 
sufficient  quality  to  support  the  identification  of  singly  deployed  air¬ 
craft.  The  GRD  range  for  this  level  is  1.3  feet  (0.4  m)  through  2.5  feet 
(0.75  m).  Snyder  et  al .  (1982)  reported  on  the  application  of  this  rating 
scale  to  the  image  quality  assessment  of  digitally  processed,  hardcopy 
imagery  that  had  been  degraded  by  various  levels  of  noise  and  blur.  The 
ratings  were  then  used  to  predict  the  ability  of  military  photointerpreters 
to  perform  an  information  extraction  task:  the  response  to  a  set  of  EEIs 
established  for  each  scene.  They  found  that  "mean  scale  scores  correlated 
quite  well  [r  =  0.90]  with  information  extration  performance."  [Ward  et  al. 
(1984)  report  on  a  similar  type  of  rating  scale  developed  for  synthetic 
aperture  radar  sensors.] 
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Section  3 
METHODOLOGY 


STIMULI 

Stimulus  preparation  was  composed  of  two  steps.  First,  a  set  of  line  draw¬ 
ings  of  tactical  fighter  aircraft  was  digitized.  Second,  digital  filtering 
was  applied  to  these  images  to  create  the  stimuli  conditions  investigated  in 
the  study. 

An  image  interpretation  aid,  a  U.S.  fighter  aircraft  comparison  wheel,  pro¬ 
duced  by  the  460th  Reconnaissance  Tactical  Squadron,  Langley  Air  Force  Base, 
served  as  the  source  material.  This  wheel  consists  of  a  transparent  overlay 
that  is  free  to  rotate  around  its  center.  The  underlay  is  printed  hard¬ 
copy.  Both  the  overlay  and  hardcopy  contain  line  drawings  of  12  aircraft. 
Six  of  these  were  selected  for  use  in  the  study.  They  were  the  A-6,  A-7, 
F-4,  F-14,  F-15,  and  F-16.  All  are  currently  flying  with  the  USAF  or  USN. 
The  dimensions  of  the  aircraft  are  presented  in  Table  3. 


TABLE  3.  AIRCRAFT  DIMENSIONS 


Ai rcraft 

Le  ngth 

Width 

A-6 

54'  7" 

53'  0" 

A-7 

46'  1.5" 

38'  9" 

F-4 

62'  11.74" 

38'  5" 

F-14 

61'  10.6" 

64'  1.5" 
(unswept) 

F-15 

63'  9.75" 

42'  9.75" 

F-16 

47'  0" 

30'  0" 

The  line  drawings  of  these  from  the  transparency  portion  of  the  comparison 
wheel  were  digitized  in  the  Visual  Image  Processing  Enhancement  and  Recon¬ 
struction  (VIPER)  facility  of  AAMRL.  VIPER  is  a  digital  image  processing 
facility  dedicated  to  supporting  research  in  human  engineering  (Kuperman, 
et  al .,  1984). 
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Digitization  of  the  line  drawings  was  performed  using  a  video  digitizing 
capability.  Each  aircraft  image  was  captured  in  a  256  by  256  picture  ele¬ 
ment  (pixel)  array  using  8  bits  (256  levels)  of  intensity  code.  The  working 
distance  of  the  digitizing  camera  was  adjusted  so  that  the  average  of  the 
aircraft  dimensions  [(length  +  width)/2]  was  approximately  half  the  size  of 
the  digital  array  into  which  each  picture  was  captured.  (The  average  of  the 
measured  dimensions  for  all  six  aircraft  was  found  to  be  126.7  pixels.)  The 
six  images  were  edited  to  remove  nonhomogeneous  areas  in  their  respective 
backgrounds.  Figure  1  presents  reconstructions  of  the  six  aircraft 
images.  The  first  column  in  the  figure  (from  top  to  bottom)  contains  the 
A-6,  A-7,  and  F-4  aircraft.  The  second  column  contains  the  F-14,  F-15,  and 
F-16. 

Once  the  aircraft  drawings  had  been  digitized,  filtered  versions  of  each 
aircraft  had  to  be  created  The  specific  filters  employed  were  derived  from 
the  channel  model  of  visual  perception.  Ginsburg  (1980)  describes  the  fil¬ 
ters  as  being  1  octave  apart  and  having  bandwidths  of  1  to  2  octaves.  Thus, 
if  a  filter  has  a  center  frequency  of  1  cycle,  then  the  next  filter  would 
have  its  center  frequency  at  2  cycles  (i.e.,  1  octave).  If  the  filter  cen¬ 
tered  at  2  cycles  was  1  octave  wide  in  bandwidth,  then  its  lower  frequency 
cutoff  would  be  at  1  cycle  and  its  upper  frequency  cutoff  would  be  at  4 
cycles.  For  this  study,  a  bandwidth  of  1.5  octaves  was  selected.  The 
center  frequencies  were  0.5,  1.0,  2.0,  4.0,  8.0,  16.0,  and  32.0  cycles  per 
digital  image  dimension.  Table  4  presents  the  passbands  of  these  filters. 


TABLE  4.  GAUSSIAN  FILTER  PASSBANDS 


Lowest 

Frequency 

Center 

Frequency 

Highest 

Frequency 

0.0 

0.5 

0.8 

0.0 

1.0 

1-7 

0.8 

2.0 

3.4 

0.4 

4.0 

6.7 

0.2 

8.0 

13.5 

0.1 

16.0 

26.9 

O 

• 

o 

32.0 

53.8 

12 


Since  the  average  dimension  of  the  six  aircraft  was  approximately  half  the 
size  of  the  total  digital  image,  the  center  frequencies  corresponded  to 
0.25,  0.5,  1.0,  2.0,  4.0,  8.0,  and  16.0  cycles  per  object  dimension.  Remem¬ 
bering  that  one  cycle  is  approximately  equivalent  to  two  lines  of  resolu¬ 
tion,  the  range  of  center  frequencies  fully  spans  the  resolution  range 
reported  to  be  required  for  aircraft  recognition.  (Erickson,  1978,  cited 
research  results  which  stated  that  approximately  12  lines  per  object  pro¬ 
duced  the  most  accurate  responses  in  an  aircraft  identification  task.) 

Figure  2  presents  a  visualization  of  the  seven  bandpass  filters.  In  the 
figure,  the  response  of  the  filter  (i.e.,  what  proportion  of  the  signal 
contained  in  the  Fourier  transform,  at  a  specific  spatial  frequency  and 
orientation)  is  depicted  in  terms  of  relative  reflectance.  Thus,  the 
brighter  portions  of  the  filter,  at  and  near  to  its  center  frequency,  pass 
spatial  frequencies  to  a  greater  extent  than  do  the  darker  areas  (those 
further  away  from  the  center  frequency).  It  should  also  be  noted  that  the 
filters  are  two  dimensional,  being  circularly  symmetric  about  the  zero 
spatial  frequency  (or  D.C.)  point  in  the  transform  plane-. 

Filtered  versions  of  each  the  six  aircraft  images  were  created  for  each 
channel  model  filter.  Figure  3  depicts  the  digital  image  processing  flow 
followed  in  creating  these  filtered  versions. 

First,  the  seven  filters  were  created.  A  VIPER  image  processing  command, 
two-dimensional  filter  (TDF)  was  employed.  TDF  requires  the  user  to  specify 
the  shape  of  the  filter,  its  center  frequency,  and  bandwidth.  In  this  case, 
these  options  were  Gaussian  filter,  center  frequencies  of  0.5,  1.0,  2.0, 

4.0,  8.0,  16.0,  and  32.0  cycles  per  image  dimension,  and  a  bandwidth  of 
1.5  octaves.  Thus,  a  set  of  seven  filters  was  created  through  repeated 
invocation  of  the  TDF  command.  Second,  the  image  of  each  aircraft  was  sub¬ 
jected  to  Fourier  transformation  (FT).  Seven  copies  of  each  transformed 
aircraft  image  were  made,  one  to  correspond  to  each  filter.  Next,  each  copy 
of  the  FT  of  the  aircraft  was  multiplied  by  its  respective  filter.  Last, 
each  filtered  aircraft  image  transform  was  subjected  to  the  inverse  FT  pro¬ 
cess  (FT"^).  This  returned  the  filtered  images  from  the  transform  plane  to 
the  object  plane.  A  total  of  42  filtered  images  were  produced  in  this 
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Figure  2.  Reconstructions  of  Channel  Model  Gaussian 
Bandpass  Spatial  Filters 
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Figure  3.  Digital  Filtering  Flow  Diagram 

manner  (six  aircraft  x  seven  filters  =  42  filtered  images).  The  six 
original  aircraft  images  and  the  42  filtered  versions  were  recorded  on 
Type  52  Polaroid  print  film  (as  positive  prints)  using  a  Matrix  Instruments 
Color  Graphics  Camera.  Each  picture  (aircraft  and  filtered  version)  was  a 
square,  approximately  1.5  inches  (38  mm)  on  each  edge. 

Figures  4  through  9  present  the  filtered  image  series  for  each  aircraft.  In 
each  of  these  figures,  the  filtered  images  are  presented,  from  left  to  right 
and  top  to  bottom,  in  order  of  the  (increasing)  center  frequency  of  the  fil¬ 
ter  used  in  creating  them.  In  each  figure,  the  Fourier  transform  is  pre¬ 
sented,  in  image  form,  in  the  lower  right  hand  corner. 
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Figure  5.  Bandpass  Spatial  Filtered  Series,  A-7  Fighter 
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Figure  7.  Bandpass  Spatial  Filtered  Series,  F-14  Fighter 
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Figure  8.  Bandpass  Spatial  Filtered  Series,  F-15  Fighter 
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Figure  9.  Bandpass  Spatial  Filtered  Series,  F-16  Fighter 
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SUBJECTS 


Seven  members  assigned  to  the  Sensor  Evaluation  Branch,  Mission  Avionics 
Division  of  the  Air  Force  Wright  Aeronautical  Laboratories,  Wri ght-Patterson 
Air  Force  Base,  Ohio,  served  as  subjects  (Ss)  in  this  study.  All  were  male 
and  all  report  20/20  visual  acuity  (corrected  or  uncorrected).  SI  through 
S3  were  USAF  trained  imagery  interpreters  and  were  all  familiar  with  the 
ASCC  rating  scale.  SI  and  S3  also  had  experience  in  employing  other  subjec¬ 
tive  image  quality  assessment  techniques.  (Kuperman,  1980,  provides 
descriptions  of  some  of  these  other  techniques.)  Among  the  trained  inter¬ 
preters,  S3  had  the  least  experience  (12  years)  and  SI  had  the  most  experi¬ 
ence  (28  years).  S4  and  S5  were  neither  trained  in  imagery  interpretation 
nor  experienced  in  image  quality  assessment.  S6  and  S7  were  highly  familiar 
with  image  quality  assessment  techniques  having  had  on-the-job  experience, 
as  either  a  primary  or  secondary  position  duty,  for  at  least  10  years.  In 
addition,  S6  had  specific  experience  with  a  similar  rating  scale  developed 
for  SAR  sensors  (presented  in  Ward  et  al.,  1984).  All  Ss  participated  in 
this  study  on  a  voluntary  basis,  subject  to  the  requirement  that  this  parti¬ 
cipation  did  not  interfere  with  the  performance  of  their  mission  related 
duties. 

Because  of  the  diversity  of  the  Ss'  backgrounds  and  in  view  of  the  apparent 
simplicity  of  administering  the  rating  scale,  it  was  decided  to  provide  each 
S  with  an  abstract  task,  similar  to  the  rating  scale,  to  provide  an  opppor- 
tunity  for  practice.  The  practice  case,  described  below,  was  intended  to 
serve  as  a  familiarization  with  the  general  procedure,  not  as  demonstration 
of  criterion  performance.  (S2,  the  S  most  experienced  with  the  rating 
scale,  omitted  the  practice  case.) 

PRACTICE 

A  single  set  of  seven  practice  images  was  prepared  using  the  identical  image 
processing  steps  employed  for  creating  the  test  stimuli.  The  object  in  the 
practice  case  was  a  white  square,  128  pixels  on  a  side,  centered  in  a  256  x 
256  pixel  black  field.  A  practice  image  interpretability  rating  scale  (con¬ 
tained  in  the  appendix)  was  prepared  using  the  ASCC  rating  scale  as  a 
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model.  Level  0  on  the  practice  scale  was  labeled  "useless  for  interpreta¬ 
tion"  while  level  8,  the  highest  level  employed,  was  labeled  "perform 
accurate  mensuration  of  object's  dimensions."  The  results  of  the  image 
quality  practice  rating  sessions  are  summarized  in  Table  5. 

TABLE  5.  SUMMARY  OF  PRACTICE  INTERPRETABILITY  RATINGS 


Filter  CF 
(cycles/object) 

Summary  Statistics 

0.25 

mean 

0.8 

S.D. 

0.7 

0.50 

mean 

1.7 

S.D. 

1.2 

1.00 

mean 

3.8 

S.D. 

1.2 

2.00 

mean 

5.5 

S.D. 

0.8 

4.00 

mean 

6.5 

S.D. 

0.5 

8.00 

mean 

7.3 

S.D. 

0.5 

16.00 

mean 

8.0 

S.D. 

0.0 

CF  =  center  frequency 
S.D.  =  standard  deviation 


The  monotonic  increase  in  mean  rating  and  the  general  decrease  in  variabil¬ 
ity  with  increasing  center  frequency  strongly  suggest  that  the  Ss  were  prop¬ 
erly  applying  the  practice  rating  scale.  Figure  10  presents  the  practice 
imagery.  The  unfiltered  square  appears  in  the  upper  left  corner  while  the 
filtered  versions,  in  order  of  increasing  center  frequency,  descend  from 
left  to  right.  The  Fourier  transform  of  the  square  is  presented  in  the 
lower  right  corner. 
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Figure  10.  Spatial  Filtering  Series  (Practice  Square) 
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In  addition  to  the  practice  rating  scale,  a  four-point  confidence  scale  was 
also  employed.  The  Ss  were  required  to  express  their  confidence  in  their 
image  interpretabil ity  rating  using  one  of  the  descriptive  phrases: 

9  Don't  Know 
•  Possible 

9  Probable 

9  Certain 

Table  6  presents  a  statistical  summary  of  the  practice  confidence  ratings. 


TABLE  6. 

SUMMARY  OF  PRACTICE  CONFIDENCE 

RATINGS 

Filter  CF 
(cycles/object) 

Summary  Statistics 

0.25 

mean 

3.2 

S.D. 

1.0 

0.50 

mean 

2.7 

S.D. 

1.2 

1.00 

mean 

2.8 

S.D. 

0.7 

2.00 

mean 

3.2 

S.D. 

0.4 

4.00 

mean 

3.5 

S.D. 

0.5 

8.00 

mean 

4.0 

S.D. 

0.0 

16.00 

mean 

4.0 

S.D. 

0.0 

CF  =  center  frequency 
S.D.  =  standard  deviation 


With  the  exception  of  the  first  two  filters,  confidence  in  the  practice 
trial  increased  monotonical  ly  with  increasing  spatial  frequency  and,  in 
general,  the  associated  variability  decreased.  The  two  highest  center 
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frequency  filters  produced  unanimous  agreement  at  the  highest  confidence 
report. 

TASK 

The  experiment  was  sel f-admi nistered  by  the  Ss.  The  complete  set  of 
instructions,  data  recording  sheets,  and  checklist  appears  in  the  appen¬ 
dix.  First,  the  S  completed  the  Training  and  Experience  Questionnaire. 
Second,  the  S  practiced  with  the  filtered  squares.  Third,  the  S  rated  the 
42  filtered  images  of  the  experiment.  (Each  S  was  presented  these  images  in 
a  unique  random  order.)  Each  S  also  provided  a  confidence  rating  (using  the 
same  four  rating  responses  that  were  employed  in  practice)  for  each  inter- 
pretability  rating. 
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Section  4 

ANALYSIS  AND  DISCUSSION 


EXPERIMENTAL  DESIGN 

A  fully  repeated  measures  design  was  employed.  Each  of  seven  Ss  was 
required  to  provide  image  i nterpretabi lity  and  confidence  ratings  for  each 
of  seven  filtered  versions  of  six  different  U.S.  tactical  fighter  air¬ 
craft.  This  resulted  in  a  total  of  294  (7x7x6)  observations. 

I  NTERPRETABI  LITY  RATINGS 

Since  no  evidence  existed  that  the  ASCC  image  i nterpretabi 1 ity  rating  scale 
possessed  equal  interval  properties  between  adjacent  levels  of  information 
extraction,  it  was  necessary  to  convert  the  ratings  into  ranked  data.  This 
was  done  using  the  rank  procedure  of  the  SAS  (1982). 

It  was  expected  that  the  six  aircraft  employed  in  the  study  would  exhibit  no 
statistically  significant  difference  from  each  other  and  could  be  pooled  as 
replicates.  This  hypothesis  was  tested  using  the  single  factor  form  of  the 
SAS  (1982)  Analysis  of  Variance  (ANOVA)  procedure.  No  significant  differ¬ 
ence  was,  in  fact,  found  and  all  subsequent  analyses  performed  this  pooling. 

The  remaining  factors,  filter  and  subjects,  together  with  their  interaction, 
pooled  over  the  six  aircraft,  were  tested  using  a  two  factor,  ANOVA  proce¬ 
dure  (SAS,  1982).  Table  7  presents  a  summary  of  this  analysis.  As  can  be 
seen  from  the  table,  the  main  effect  of  the  Ss'  performance  for  the  seven 
filters  (corresponding  to  psychovisual  channels)  was  found  to  be  highly  sig¬ 
nificantly  different.  Also,  the  performance  of  the  seven  Ss  was  signifi¬ 
cantly  different  in  an  overall  sense.  The  interaction  between  the  filters 
and  subjects  was  not  found  to  be  statistically  significant. 

The  fact  that  the  Ss  were  found  to  produce  different  image  i nterpretabi lity 
ratings  was  not  surprising  considering  the  differences  in  their  training  and 
experience  levels.  A  post  hoc  test,  Tukey's  Honestly  Significant  Difference 
(HSD)  (SAS,  1982)  statistic  was  applied  to  the  ranked  i nterpretabi 1 ity  data 
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TABLE  7.  ANOVA  SUMMARY  TABLE:  RANKED  IMAGE  INTERPRETABILITY  DATA 


Source 

D.F. 

SS 

Filters  (F) 

6 

1728318.2 

p  <  0.01 

Subjects  (S) 

6 

106308.0 

p  <  0.05 

F  X  S 

36  , 

121737.6 

N.S. 

D.F.  =  degrees  of  freedom 

SS  =  sum  of  squares 

N.S.  =  not  statistically  significant 


in  order  to  investigate  how  Ss  differed  from  each  other  with  respect  to  the 
interpretability  scale.  Figure  11  presents  the  results  of  this  test.  The 
Ss  were  found  to  be  divided  into  four  statistically  distinguishable  groups 
(p  <  .05).  S5,  one  of  the  two  Ss  who  had  neither  experience  nor  training, 

performed  as  a  unique  entity.  [Examination  of  his  data,  pooled  over  filters 
and  aircraft,  revealed  that,  in  general,  he  produced  higher  image  quality 
ratings  (and,  therefore,  rankings)  than  did  any  of  the  other  Ss.]  The  sec¬ 
ond  group  was  composed  of  SI  and  S3,  both  trained  and  experienced  imagery 
interpreters.  This  group  was  made  up  of  SI  and  S6.  S6  was  an  experienced 
imagery  analyst.  The  group  that  tended  to  produce  the  lowest  interpretabil¬ 
ity  ratings  was  formed  by  S2,  S4,  and  S7,  an  interpreter,  a  naive  S,  and  an 
analyst,  respectively.  (Figure  11  depicts  the  groupings  among  the  Ss  by  the 
lines  joining  the  arrows  that  point  to  the  S  number.)  No  consistent  pattern 
is  evident  from  this  test  regarding  the  utility  of  training  and  experience 
as  a  predictor  of  interpretability  ratings. 

It  was  decided  to  perform  a  post  hoc  computation,  the  omega^  statistic 
(Simons,  1971),  to  determine  the  degree  to- which  each  factor  in  the  design 
contributed  to  the  total  variance  encountered  in  the  resulting  data.  The 
main  effect  of  filters  accounted  for  84  percent  of  the  total  variance  and 
the  main  effect  of  subjects  accounted  for  5  percent  of  the  variance.  (The 
F  X  S  interaction,  while  not  significant,  accounted  for  6  percent  of  the 
observed  variability.  The  remaining  variance  was  contributed  by  the  error 
term  of  the  linear  model.) 
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Figure  11.  Post  Hoc  Test  on  Subjects  (Pooled 
Image  Interpretability  Scale  Data) 


The  nature  of  the  highly  significant  difference  found  (in  the  two-factor 
ANOVA)  for  the  imagery  processed  through  the  seven  channel  model  spatial 
filters  was  also  investigated  using  Tukey's  HSD  statistic  (SAS,  1982)  on  the 
ranked  interpretability  data  (pooled  over  aircraft).  The  filtered  images 
were  divided  into  six  distinct  rating  groups.  Images  produced  through  the 
two  filters  having  the  lowest  center  frequencies  (0.25  and  0.50  cycles  per 
object  dimension)  formed  one  group  while  each  of  the  remaining  five  filters 
(1.00,  2.00,  4.00,  8.00,  and  16.00  cycles  per  object  dimension)  gave  rise  to 
imagery  that  was  rated  into  a  statistically  separable  (p  <  0.05)  image 
interpretability  group.  Figure  12  graphically  depicts  the  means  and  stan¬ 
dard  deviations  for  the  ASCC  image  interpretability  rating  scale  data, 
pooled  acrosss  Ss  and  aircraft. 

CONFIDENCE  RATINGS 

The  interpreter  confidence  ratings  were  transformed  into  confidence  rankings 
in  order  to  achieve  equal  interval  properties  between  the  response  levels. 
The  SAS  (1982)  rank  procedure  was  used  to  effect  this  manipulation. 

A  one-way  ANOVA  (SAS,  1982)  was  again  applied  to  the  factor  of  aircraft  type 
(using  the  ranked  confidence  data,  pooled  across  filters  and  Ss).  No  sig¬ 
nificant  difference  between  aircraft  types  was  found. 
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i _ j  i  t  f  t  t  TUKEY’S  HSD 

Figure  12.  Means  and  Standard  Deviations  for  Image 

Interpretability  Rating  Scale  Data  (Pooled 
Over  Aircraft  and  Subjects) 

The  remaining  factors,  filters  and  Ss,  together  with  their  interaction,  were 
subjected  to  a  two-factor  ANOVA  (SAS,  1982).  Table  8  presents  the  summary 
of  this  analysis.  As  is  indicated  in  the  table,  the  Ss'  confidence  in  their 
interpretability  ratings  differed  significantly  on  the  basis  of  which  filter 
had  been  employed  in  processing  the  imagery.  Neither  the  main  effect  of  Ss 
nor  the  F  x  S  interaction  was  found  to  be  statistically  significant. 

The  omega^  statistic  (Simons,  1971)  was  also  applied  to  these  data  to 
determine  the  contribution  of  each  source  of  variation  to  the  total  observed 
variability  in  the  data.  The  main  effect  of  filters  contributed  17  percent 
of  the  total,  that  of  Ss  accounted  for  6  percent,  but  their  interaction  gave 
rise  to  41  percent. 


31 


TABLE  8.  ANOVA  SUMMARY  TABLE:  RANKED  IMAGE  INTERPRETAB  I  LIT Y  DATA 


Source 

D.F. 

SS 

Filters  (F) 

6 

316183.9 

p  <  0.05 

Subjects  (S) 

6 

109788.4 

N.S. 

F  X  S 

36 

771827.7 

N.S. 

D.F.  =  degrees  of  freedom 
SS  =  sum  of  squares 
N.S.  =  not  significant 


Tukey's  HSD  statistic  (SAS,  1982)  was  applied  to  the  ranked  confidence  data 
(pooled  across  Ss  and  aircraft).  Three  significantly  distinct  (p  <  .05) 
groupings  of  the  filtered  imagery  were  found.  The  first  group,  which  gave 
rise  to  the  highest  levels  in  reported  confidence,  was  made  up  of  the 
imagery  filtered  at  the  two  lowest  (0.25  and  0.5  cycles  per  object  dimen¬ 
sion)  and  the  two  highest  (8.00  and  16.00  cycles  per  object  dimension)  cen¬ 
ter  frequencies.  The  second  group,  which  partially  overlapped  the  first  and 
which  gave  rise  to  an  intermediate  level  in  mean  S  confidence,  was  made  up 
of  imagery  produced  by  filters  having  the  lowest  (0.25)  and  the  second  and 
third  highest  (4.00  and  8.00)  center  frequencies  (cycles  per  object  dimen¬ 
sion).  The  last  group  was  made  up  of  imagery  created  using  filters  with 
center  frequencies  of  1.00  and  2.00  cycles  per  object  width;  this  group  pro¬ 
duced  the  lowest  average  confidence  ratings.  [Figure  13  presents  the  mean 
confidence  rankings  (normalized)  in  graphic  form.] 

REGRESSION  ANALYSIS 

The  ANOVA  on  interpretability  rating  tested  the  statistical  significance  of 
the  obtained  rating  on  the  spatial  filter  (and  other  factors)  used  to  gener¬ 
ate  the  test  imagery.  The  ANOVA  procedure  is  based  on  a  linear  model.  The 
exact  relationship  between  the  spatial  filters  and  the  ratings  can  be  esti¬ 
mated  by  regression.  What  is  desired  is  a  predictor  equation  for  image 
interpretability  rating  based  on  the  filter,  specifically  on  the  center  fre¬ 
quency  of  the  filter. 
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SPATIAL  FILTERS  (CYCLES/OBJECT) 

Figure  13.  Mean  (Normalized)  Confidence  Rankings 


The  SAS  (1982)  regression  procedure  was  applied  to  the  ratings  for  each 
observation  by  center  frequency  of  the  filter  used  to  create  the  stimulus. 
The  regression  equation  that  resulted  was: 

Ratings  =  0.431  (Center  Frequency)  +  1.579 

The  r^  for  this  equation  was  found  to  be  0.562.  A  scatterplot  of  the  mean 
ratings  (pooled  over  Ss)  is  presented  in  Figure  14  along  with  the  regression 
line.  It  is  apparent  from  the  figure  that  the  form  of  the  regression  equa¬ 
tion  is  determined  by  the  fact  that  the  data  from  the  three  lowest  center 
frequency  and  the  highest  center  frequency  filters  fall,  generally,  below 
the  line  while  the  remaining  means  appear  above  it. 
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The  of  0.562  suggests  that  there  is  linear  relationship  between  the  cen¬ 
ter  frequency  of  the  Gaussian  bandpass  spatial  filter  and  the  image  inter- 
pretability  rating  to  be  associated  with  the  quality  of  the  resultant 
reconstruction.  Table  9  presents  one  possible  way  in  which  the  relationship 
between  information  content  and  digital  filter  center  frequency  may  be 
represented.  In  constructing  the  table,  the  regression  equation  was 
inverted  to  predict  center  frequency  as  a  function  of  rating.  The  levels  of 
information  that  can  be  exploited  from  imagery  of  the  rated  levels  shown  was 
extracted  from  the  ASCC  rating  scale  descriptors. 


TABLE  9.  INFORMATION  CONTENT 


Rati ng 

Center  Frequency 

Level  of  Information 

0 

— 

Useless 

1 

— 

Detect  Large  Aircraft 

2 

1.0 

Count  Large  Aircraft  (by  wing  type) 

3 

3.3 

Detect/Count  All  Aircraft 

4 

5.7 

Recognize  Aircraft 

5 

7.9 

Detect  Presence  of  Alphanumerics 
on  Wings  of  Large  Aircraft 

6 

10.3 

Identify  Aircraft  (by  canopy  type) 

7 

12.6 

(No  Additional  Information) 

8 

14.9 

Identify  All  Aircraft 

9 

— 

(No  Additional  Information) 

The  regression  analysis  demonstrated  a  linear  relationship  between  image 
interpret ability  rating  and  channel  center  frequency.  Since  the  rating 
value  is  reported  to  correspond  to  the  level  of  information  available  for 
exploitation  and  since  these  levels  of  information  form  a  hierarchy,  then 
the  channel  model  filters  may  also  be  considered  to  produce  a  hierarchial 
organization  of  visual  perception. 
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Section  5 

CONCLUSIONS  AND  RECOMMENDATIONS 


CONCLUSIONS 

1.  For  the  fighter  aircraft  types  and  digital  image  processing  opera¬ 
tions  considered  in  this  study,  no  significant  difference  was 
found  between  aircraft  in  an  image  interpretability  rating  task. 

2.  The  channel  model,  when  applied  as  digital  image  processing  fil¬ 
ters,  produced  imagery  which  resulted  in  image  quality  ratings 
(ASCC  imagery  interpretability  scale)  that  were  highly  signifi¬ 
cantly  different  from  each  other  (p  <  0.01). 

3.  The  rating  scale  employed  revealed  significant  differences  between 
the  Ss  who  applied  it  (p  <  0.05).  No  consistent  pattern  between 
the  training  and  experience  of  the  Ss  and  their  ratings  was 
observed. 

4.  No  difference  was  found  between  aircraft  types  on  the  basis  of  the 
Ss'  confidence  in  their  interpretability  ratings. 

5.  The  channel  model  filters  produced  significant  (p  <  0.05)  differ¬ 
ences  in  terms  of  interpreter  confidence  reports. 

6.  No  differences  were  found  between  Ss  nor  was  there  a  significant 
interaction  between  filters  and  Ss  for  the  dependent  variable  of 
confidence  in  interpretability  rating. 

7.  The  highest  average  confidence  ratings  were  produced  by  the 
imagery  created  using  the  two  highest  and  two  lowest  center 
frequency  spatial  filters  (0.25,  0.50,  8.00,  and  16.00  cycles  per 
object  dimension).  The  lowest  confidence  ratings  came  from 
imagery  based  on  spatial  filters  of  intermediate  center  frequency 
(1.00  and  2.00  cycles  per  object  dimension). 
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8.  A  linear  predictor  equation  was  developed  to  relate  the  center 
frequency  of  the  spatial  filter  to  the  interpretability  rating 
that  would  be  produced  (r^  =  0.5623).  This  equation,  together 
with  the  descriptors  associated  with  the  ASCC  rating  scale,  allow 
prediction  of  the  information  to  be  extracted  from  imagery  pro¬ 
cessed  with  Gaussian  weighted,  bandpass  spatial  filters  of  the 
center  frequencies  used  as  the  independent  variables. 

9.  In  summary,  the  channel  model  of  visual  perception  was  found  to  be 
linearly  related  to  an  operationally  accepted  and  employed  recon¬ 
naissance  imagery  interpretability  scale.  The  scale  was  based  on 
a  hierarchy  of  information  extraction  levels.  Hence,  the  several 
spatial  filters  which  together  compose  the  channel  model,  may  be 
considered  to  also  correspond  to  distinct  levels  of  information 
extraction. 

RECOMMENDATIONS 

The  channel  model  has  been  demonstrated  to  correlate  with  image  quality 
ratings  derived  in  the  context  of  information  extraction  tasks  (imagery 
interpretation).  This  finding  has  direct  application  to  a  variety  of  opera¬ 
tional  Air  Force  problems  in  which  information  content,  stimulus  complexity, 
image  quality,  display  design,  and/or  visual  information  transfer  are  sig¬ 
nificant  parameters.  It  is  recommended  that  the  channel  model  be  investi¬ 
gated  for  possible  application  to: 

1.  The  design  of  bandwidth  compression  algorithms  which  optimize  the 
reconstructed  imagery  with  respect  to  the  psychovisual  capabili¬ 
ties  of  the  observer. 

2.  The  assessment  of  display  image  quality. 

3.  The  design  of  imagery  interpretation  equipment. 

4.  The  quantification  of  visual  fatigue  experienced  by  imagery 
interpreters. 
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APPENDIX 

TWO-DIMENSIONAL  FILTERING  EXPERIMENT 
INSTRUCTIONS  TO  SUBJECTS 
Purpose 

Psychologists  working  in  the  area  of  visual  perception  have  developed 
theories  of  vision  that  suggest  that  an  image  is  broken  down  into  its  com¬ 
ponent  parts  before  the  brain  processes  the  information  contained  in  the 
image.  This  experiment  is  an  attempt  to  determine  what  components  of  an 
image  (photograph)’ of  an  aircraft  contain  information  required  by  an  imagery 
interpreter/analyst  in  order  to  carry  out  an  image  quality  rating  task.  The 
results  of  this  study  will  help  the  Air  Force  in  designing  better  image 
interpretation  equipment  and  methods. 

All  information  regarding  your  participation  in  this  experiment  will  be  kept 
confidential.  Only  group  data  (all  subjects)  will  be  reported  and  your 
individual  answers  will  be  kept  in  confidence. 

Please  perform  the  experiment  by  yourself.  Do  not  consult  with  any  other 
subjects  or  compare  answers. 

Your  part  in  the  experiment  should  take  between  1  and  2  hours.  Please  work 
at  your  own  pace. 

Materi  al  s 

In  order  to  carry  out  your  part,  you  will  need  four  things: 

1.  Subject's  Packet:  This  large  envelope  contains  a  short  questionnaire 
concerning  your  training  and  experience  as  an  imagery  interpreter/ 
analyst,  an  answer  sheet  for  the  practice  images,  and  an  answer  sheet 
for  the  test  images.  (A  checklist  is  also  provided  to  help  you  perform 
your  part  of  the  experiment  in  the  correct  sequence.) 
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2.  Practice  Imagery  Packet:  This  large  envelope  contains  seven  small 
envelopes,  each  with  a  4  x  5  inch  print  inside  it. 

3.  "School  Solution"  Packet:  This  envelope  contains  six  prints.  Each 
print  is  a  picture  of  a  fighter  aircraft  with  the  designation  and 
nickname  for  that  aircraft  given.  (You  will  use  these  pictures  as  if 
they  were  part  of  an  imagery  interpretation  key  when  you  carry  out  the 
experiment.)  A  copy  of  the  NATO  Air  Standardization  Coordinating 
Committee  Image  Interpretability  Scale  (ASCC-AIR  STD  101/11,  10  July 
1978)  is  also  contained  in  this  packet. 

4.  Test  Imagery  Packet:  This  large  envelope  contains  42  small  envelopes. 
Each  small  envelope  (a)  is  marked  with  a  code  number  and  (b)  contains  a 
single  print.  These  are  the  images  that  you  will  be  rating  during  the 
experiment. 

Procedure 

Your  part  in  the  experiment  is  made  up  of  the  following  steps: 

1.  Subject  Packet.  Take  an  unsealed  subject  packet.  Remove  the 
"Subject's  Training  and  Experience  Questionnaire."  Complete  the 
Questionnaire. 

2.  Practice  Photos.  Take  the  seven  practice  photos  and  the  Practice 
Answer  Sheet.  Study  the  Interpretability  Scale  and  Confidence  Ratings 
on  the  first  page  of  the  Practice  Answer  Sheet.  Use  these  ratings  to 
rate  the  seven  practice  photos.  You  may  rate  the  practice  photos  one 
at  a  time  or  all  seven  together.  When  you  are  finished,  replace  the 
practice  photos  in  the  Practice  Photo  Packet  and  place  your  Practice 
Answer  Sheet  in  your  Subject's  Packet. 

3.  Experiment.  Take  the  six  "School  Solution"  photos  and  study  them. 

Note  similarities  and  differences  between  the  six  aircraft.  (Look  at 
the  shape  of  the  wings,  the  tail,  the  shape  and  position  of  the  canopy 
along  the  fuselage,  the  number  of  engines,  the  shape  of  the  nose,  etc.) 
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Now  take  the  42  experiment  photos  and  the  Experiment  Answer  Sheet, 

Look  at  the  first  Image  Number  on  the  Answer  Sheet.  Find  the  photo 
envelope  with  the  same  number  marked  on  it.  Remove  the  photo.  (Check 
that  the  number  marked  on  the  photo  is  the  same  number  as  is  on  the 
envelope.)  Study  the  photo.  Using  the  NATO  Interpretability  Rating 
Scale,  mark  the  interpretability  level  number  on  the  Answer  Sheet. 

Then  mark  your  confidence  rating.  Replace  the  photo  in  its  envelope. 
Go  on  to  the  next  Image  Number  (as  marked  on  the  Answer  Sheet). 
Continue  until  you  have  rated  all  42  photos. 
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SUBJECT'S  TRAINING  AND  EXPERIENCE  QUESTIONNAIRE 


Name _ Date _ 

Grade/Rank _ Organization _ 

1.  Read  the  Instructions  to  Subjects.  Please  indicate  that  you  have  read 

and  understand  the  Instructions  by  signing  your  name  on  the  next  line. 
(Signature)  _ 

2.  Do  you  wear  eyeglasses  or  contact  lenses  when  you  work  as  an  imagery 

interpreter/analyst?  Yes  _  No  _ 

(If  the  answer  is  yes,  please  wear  your  glasses/lenses  while  carrying  out 
the  experiment.) 

3.  What  training  have  you  received  as  an  imagery  interpreter/analyst? 
(Please  list  any  military  schools,  short  courses,  special  certifications, 
and  special  on-the-job-training  that  you  may  have  received.) 


4.  How  many  years  have  you  worked  as  an  interpreter/analyst?  _ 

5.  Have  you  ever  been  trained  to  use  the  NATO  Rating  Scale  (or  similar 

interpretabil ity  rating  scales)?  Yes _  No _ 

(If  you  have  worked  with  similar  scales,  please  identify  them.  _ 


6.  Please  list  any  specialized  image  interpretation  or  image  analysis 
equipment  that  you  have  used  in  your  work. _ _ 
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CHECKLIST 


1.  Subject  Questionnaire 

2.  Practice 

-  Practice  Photos 

-  Practice  Answer  Sheet 

Rate  the  practice  photos. 

Replace  the  practice  photos  in  their  packet. 

Put  your  Practice  Answer  Sheet  in  your  Subject  Packet. 

3.  "School  Solution" 

-  "School  Solution"  Photos 

Study  them;  note  similarities  and  differences. 

4.  Experiment 

Arrange  photo  evelopes  in  order. 

Rate  the  photos. 

Refer  to  "khool  Solution"  Photos  (if  you  want  to). 

5.  Replace  Experiment  Photos 
Replace  "School  Solution"  Photos. 

6.  Place  answer  sheets  and  questionnaire  in  Subject's  Packet  and  seal  the 
flap. 
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PRACTICE  ANSWER  SHEET 


INTERPRETABILITY 


The  practice  photos  each  contain  "filtered"  versions  of  a  square  in  the 
center  of  the  photo.  You  are  asked  to  estimate  the  level  of  interpret- 
ability  that  each  practice  photo  would  support.  You  are  not  asked  to  do  any 
interpretation  or  analysis.  Use  the  following  ratings  to  rate  the  seven 
practice  photos: 


Level  0 
Level  1 
Level  2 
Level  3 
Level  4 

Level  5 
Level  6 

Level  7 

Level  8 


Useless  for  interpretation. 

Detect  the  presence  of  an  object. 

Locate  the  position  of  the  object  within  the  photograph. 

Determine  the  orientation  of  the  object. 

Recognize  the  shape  of  the  object  with  low  confidence 
(possible). 

Estimate  the  aspect  ratio  (length-to-width)  of  the  object. 

Recognize  the  shape  of  the  object  with  medium  confidence 
(probable) . 

Recognize  the  shape  of  the  object  with  high  confidence 
(certainty). 

Perform  accurate  mensuration  of  object's  dimensions. 


CONFIDENCE 


Please  use  the  following  descriptive  words  in  reporting  your  confidence  in 
the  interpretability  rating  that  you  assign: 

"Don't  Know" 

"Possible" 

"Probable" 

"Certain" 
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PRACTICE  ANSWER  SHEET 


IMAGE  NO.  INTERPRETABILITY  CONFIDENCE 

PI  _ _ _ _  _ 

P2  ■  ' _  _ 

P3  _ ^ _ _  _ 

P4 _ _  _ _ 

P5  _  _ _ 

P6  _  _ 

P7  _ 
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EXPERIMENT  ANSWER  SHEET 


Use  the  NATO  Interpretability  Scale. 

Use  these  confidence-describing  terms:  "Don't  Know" 

"Possible" 

"Probable" 

"Certain" 

IMAGE  NO.  INTERPRETABILITY 


CONFIDENCE 
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